PERSISTENCE IN FLUCTUATING ENVIRONMENTS 
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SEBASTIAN J. SCHREIBER, MICHEL BENAIM, AND KOLAWOLE A. S. ATCHADE 

Abstract. Understanding under what conditions interacting populations, whether they be plants, 
animals, or viral particles, coexist is a question of theoretical and practical importance in population 
biology. Both biotic interactions and environmental fluctuations are key factors that can facilitate 
or disrupt coexistence. To better understand this interplay between these deterministic and sto- 
chastic forces, we develop a mathematical theory extending the nonlinear theory of permanence 
for deterministic systems to stochastic difference and differential equations. Our condition for co- 
existence requires that there is a fixed set of weights associated with the interacting populations 
and this weighted combination of populations' invasion rates is positive for any (ergodic) stationary 
distribution associated with a subcoUection of populations. Here, an invasion rate corresponds to 
an average per-capita growth rate along a stationary distribution. When this condition holds and 
there is sufficient noise in the system, we show that the populations approach a unique positive 
stationary distribution. Moreover, we show that our coexistence criterion is robust to small pertur- 
bations of the model functions. Using this theory, we illustrate that (i) environmental noise enhances 
or inhibits coexistence in communities with rock-paper-scissor dynamics depending on correlations 
between interspecific demographic rates, (ii) stochastic variation in mortality rates has no effect on 
the coexistence criteria for discrete-time Lotka-Volterra communities, and (iii) random forcing can 
promote genetic diversity in the presence of exploitative interactions. 

Submitted to Journal of Mathematical Biology 

One day is fine, the next is black. -The Clash 

1. Introduction 

The interplay between biotic interactions and env ironmental fluctuations plays a crucial role 
in determining species richness and genetic diversity Gillespid. Il973l. IChesson and Warnerl. 1 1981 



2001 



Turelli Il98ll. IChessonl. ll994lEllner and Sasaki! . Il996l . lAbrams et al.l . Il998l . iBjornstad and Grenfell , 



Kuang and Chessonl . |2008| . |2009|. F o r exa mple, competition for limited resources Gausd . 



1934| or sharing common predators [Holtl . Il977l | may result in species or genotypes being dis- 



placed. However, random forcing of these systems can reverse these trends and, ther eby, enhance 
diversity JGillespie and Guesd . Il978l IChesson and Warnerl . Il98ll . lAbrams et al.l. 1998 1. Conversely, 
differential predation can mediate coexistence between competitors Paind . Il966l . JHolt et al.l . Il994j . 
Chesson and Kuangi . l2008l |. yet environmental fluctuations can disrupt this coexistence mechanism. 
A fruitful approach to study this interplay is developing stochastic difference or differential e quations 
and analyzing the Igng-terrn behavior of the probability distribution of the population sizes Turelli , 
198ll.lChessonl.ll982llGardl.ll984j.[Ch^sson and EUneii . Il989l . JEUnei] . Il989l JGvllenberg et al.l . ll994al Jbl. 
Schreibeil . l2007l JBenai'm et al.l . 12008 
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An intuitive approach to the problem of coexistence is given by considering; the average per - 
capita growth rate of a population when rare |Turellil . Il978l iGardl . Il984i IChesson and EUnerl . Il989 



When this growth rate is positive, the population can increase and "invade" the system. For 
pairwise interactions, one expects that coexistence is e nsured if ea ch p opulation can invade when 
it is rare and the other population is common. Indeed, iGardI 1984J and IChesson and EUnerl |1989 



have shown for predator-prey interactions and competitive i nteractions that "mut ual invasibility" 



ensures coexistence in the sense of stochastic boundedness [Chessonl . Il978l . Il982| : the long-term 



distribution of each population is bounded below by a positive random variable. Going beyond 
pairwise interactions, this mutual invasibility criterion suggests that coexistence should occur if 
a missing population can invade any subcommun ity of the interacting po pulations. Surprisingly, 
this criterion false even for deterministic systems. iMay and LeonardI |1975| showed with numerical 
simulations that competing species exhibiting a rock-paper-scissor dynamic need not coexist despite 
every subcommunity being invadable by a missing species. 

Starting in the late 1970s, mathematicians developed a coexistence theory f or deterrninistic 



models that could handle rock-paper-scissor type dynamics [Schuster et al.l. Il979l iHofbauerl. 11981 



19981 . ISchreibei 



Hutsonl.ll984l.lButler and Waltmanl.ll986l.lHofbauer and Sd.ll989l.lHutson and Schmittl.ll992 . lJansen and Sigm 



2OOOI iGarav and Hofbaueil . l2003l . iHofbauer and Schreibed . l2004l . ISchreibeA I2OO6I 



Their notion of coexistence, known as permanence or uniform persistence, ensures that popula- 
tions coexist despite fr equent small perturbations or rare large perturbations Jansen and Sigmundl . 



19981 . ISchreiberl . |2006| . A sufficient condition for permanence is the existence of a fixed set of 
weights associated with the interacting populations such that this weighted combination of pop- 
ulations' inv asion rates is positive for any invariant measure associated with a sub-collection of 



populations jHofbauerl . Il981l ISchreiberl . |2000| . iGaray and Hofbauerl . |2003| . Conversely, if there is a 



convex combination of the invasion rates that is negative for all invariant measures associated with 
a sub- collection of populations, then the community has one or rn ore populations that is extinction 



prone 



Garay and Hofbauerl . l2003l . iHofbauer and Schreiberl . 12004 



Whi le environmental stochasticity is often cited as a mo tivation for the concept of perma- 



nence [Hutson and Schmittl . Il992l . iJansen and Sigmundl . Il998| , onl y recently has t he eff ect of envi- 
ronmental stochasticity on permanent systems been investigated. iBenaim et al.l 2008| found if a 
deterministic continuous-time model satisfies the aforementioned permanence criterion, then, un- 
der a suitable non-degeneracy assumption, the corresponding stochastic differential equation with 
a small diffusion term has a positive stationary distribution concentrated on the positive global 
attractor of the deterministic system. Consequently, permanent systems persist despite continual, 
but on average small, random perturbations. Conversely, if the deterministic dynamics satisfies 
the impermanence criterion, then the stochastic dynamics almost surely converges to the boundary 
of the state space. This asymptotic loss of one or more species occurs even if there is a positive 
attractor for the underlying deterministic dynamics. 

For many systems, stochastic perturbations may n ot be small an d these perturbations may not 



be best described by stochastic differential equations |Turellil . Il978| . Here, in sections |2] and |3l we 



develop a natural generalization of the permanence criteria for stochastic difference and differential 
equations with arbitrary levels of noise. The proofs of these results are presented in the Appendices. 
In section HJ we develop applications of these results to competitive lottery models, discrete-time 
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Lotka-Volterra models with environmental disturbances, and stochastic replicator equations. In 
particular, we show how environmental stochasticity can enhance or disrupt diversity in these 
models. 

2. Discrete time models 

2.1. The models. We study the dynamics of k interacting populations in a random environment. 
Let XI denote the density of the i-th population at time t and Xf = {X^, . . . ,X^) the vector of 
population densities at time t\j To account for environmental fluctuations, we introduce a random 
variable ^t that represents the state of the environment (e.g. temperature, nutrient availability) 
at time t. The fitness fi{Xt,^t+i) of population i at time t depends on the population state and 
environmental state at time t + 1. Under these assumptions, we arrive at the following stochastic 
difference equation: 

(1) Xi+i = /(X„6+i)°^* 

where f{x, C.) = {fi{x, ^), . . . , /^(x, ^)) is the vector of fitnesses and o denotes the Hadamard product 
i.e. component-wise multiplication. 

Regarding ([1]), we make four assumptions: 

Al: There exists a compact set S of R^ = {a; G R'^ '■ Xi > 0} such that Xj G S for all t > 0. 
A2: {C,t}'^Q is a sequence of i.i.d random variables independent of Xq taking values in a 

probability space E equipped with a cr-field and probability measure m. 
A3: fi{x,^) are strictly positive functions, continuous in x and measurable in ^. 
A4: For all i, sup^gg /(log/j(x, ^))^m((i^) < oo 

Assumption Al ensures that the populations remain bounded for all time. Assumptions A2 and 
A3 imply that {X(}^q is a Markov chain on S and that {Xfj^Q is Feller, meaning that Ph, as 
defined below, is continuous whenever h is continuous. Assumption A4 is a technical assumption 
meet by many models. 

2.2. Some ergodic theory. In order to state our main results, we introduce some notation and 
review some basic concepts from ergodic theory. For any Borel set A C S and x G S, let 

F4XteA]=F[XteA\Xo = x]. 

be the probability Xt is in A given that Xq = x. For various notions of convergence, it is useful 
to consider how the expected value of an "observable" (a function h from S — )■ R) depends on the 
dynamics of Xt. Give a bounded or nonnegative measurable function /i : S i— )■ R, define 



E[/i(Xi)|Xo = x]= fh{f{x,0°x)HdO 



to be the expected value of h in the next time step given that the current state of the population is 
X. Let P be the operator on bounded measurable functions defined by Ph{x) = E[/i(Xi)|Xo = x]. 



For sequences of random vectors, we use subscripts to denote time t and superscripts to denote components of 
the vector. For all other vectors, we use subscripts to denote components of the vector. 
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To understand the long-term statistical behavior of the population dynamics, it is useful to 
introduce invariant probability measures. Roughly, a probability measure /i is invariant if the 
population initially follows the distribution of fi, then it follows this distribution for all time i.e. if 
P[Xo e A] = fi{A) for all Borel sets AcS, then F[Xt e A] = fi{A) for all t and all Borel sets A C S. 
One can phrase this invariance in terms of observables /i : S — )■ R. If Xq follows the distribution 
of /i, then the expected value of h{Xo) equals Jg h{x) fi{dx) and the expected value of h{Xi) equals 
L Ph{x) fi{dx). It follows that a Borel probability measure /i is invariant for {Xtj^Q or P if 



(2) / h{x)fi{dx)= / Ph{x)n{dx) 

is Js 

for all continuous bounded functions /i : S — t- R. We let V denote the space of Borel probability 

measures on S 

If Xt initially follows the distribution of an invariant probability measures /i, then Birkhoff's 

ergodic theorem implies that the temporal averages of an observable along a population trajectory 

converges with probability one. More precisely, ii h : S — t- R is a measurable function with 

Jg \h{x)\ fi{dx) < oo, then there exists a measurable function /i : S — )■ R such that J^ \h{x)\ fi{dx) < 

oo and 

1 *"^ 
lim-VMX,) = /i(Xo) 

t— >-oo t ^—^ 

with probability one. When /i is a constant function for all bounded measurable /i, /i is called an 
ergodic probability measure in which case 

1 *"^ r 

(3) lim - V h(Xs) = / h(x) ^(dx) 

i-i-oo t ^ — ^ a 

s=0 ^° 

with probability one. Since Jg h{x) fi{dx) corresponds to the expected value of h(Xo), equation ([3]) 
can be interpreted as a law of large numbers for Xt. 

While the Birkhoff ergodic theorem provides a relatively complete picture of the long-term sta- 
tistical behavior of Xf, it only does so when Xq is initially distributed like an invariant probability 
measure. However, as we are interested in the long-term behavior of Xt for any positive initial 
condition Xq, new results are needed that require the concept of an invasion rate. 

2.3. Invasion rates. The expected per-capita growth rate at state x of population i is 

Xi{x) = / log fi{x,^)m{d^). 



When Xi{x) > 0, the z-th population tends to increase when the current population state is x. 
When Aj(x) < 0, the i-th population tends to decrease when the current population state is x. For 
an invariant probability measure /x, we define the invasion rate of species i with respect to /x to be 

Ai(yu) = / Xi{x) iJ,{dx) 
Js 

The following proposition clarifies why Aj(/x) is called an invasion rate. Its proof is in Appendix A. 
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Proposition 1. Let ji he an invariant probability measure and i E {I, . . . , k}. Then there exists a 
bounded map Aj : S — ;■ R such that: 

(i) With probability one and for ^-almost every a; G S 

1 *"^ 
lim -y^\ogfi{Xs,^s+i) = Ai(x) when Xq = x; 

s=0 

(ii) Jg \i{x)ji{dx) = Aj(/i); Furthermore if fi is ergodic, then Aj(x) = Aj(/i) ji-almost surely. 
(ill) If fJ^{{x G S : Xi> 0}) = 1, then Ai(/i) = 0. 

When fi is ergodic, Xi{fi) is tlie long-term time average of tlie per-capita growtli rate of population 
i. Moreover, since each of the set {xi = 0} is invariant under the dynamics in ([T]), there exists a 
set supp(yu) C {1, . . . , A;} such that Xj > if and only if i G supp(/i) for yU-almost all x. One can 
interpret supp(/i) as the set of populations supported by /i. Quite intuitively. Proposition [1] implies 
that the long-term average of the per-capita growth is zero for all populations supported by fi i.e. 
Ai(/i) = for all i G supp(/i). 

2.4. Persistence. To quantify persistence, there are two ways to think about the asymptotic be- 
havior of {Xt}'^Q. First, one can ask what is the distribution of X^ far into the future. For example, 
what is the probability that the population density of each state is greater than e in the long term 
i.e. F[Xt > (e, . . . , e)] for large t? The answer to this question provides information what happens 
across many independent realizations of the population dynamics. Alternatively, one might be in- 
terested about the statistics associated with a single realization of the process i.e. a single time 
series. For instance, one could ask what fraction of the time was the density of each population 
state greater than e? To answer this question, it is useful to introduce the occupation measures 



1 * 



s=\ 

where bx^ denotes a Dirac measure at Xg i.e. (5xs(^) = 1 if X^ G A and otherwise for any (Borel) 
set y4 C S. One can interpret ^t{-^ as the proportion of time the population spends in A up to 
time t. 

Our first theorem addresses persistence from the second perspective. To state this theorem, for 
?7 > 0, let S^ = {x G S" : Xj < ?7 for some z} be the set of the states where at least one population has 
an abundance less than or equal to r]. Sq corresponds to the states where one or more populations 
is extinct. 

Theorem 1 (Persistence). Assume that one of the following equivalent conditions hold: 
(i) For all invariant probability measures /i supported on Sq, 

A*(/i) := maxAj(/i) > 

i 

(ii) There exists p E A such that 

^PiXiin) > 
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for all ergodic probability measures fi supported by Sq. 
Then for all e > there exists 77 > such that 

linisupnt(S^) < e almost surely 

whenever Xq = x G S \ Sq- 

Theorem [1] implies that fraction of time spent by the populations in S^ goes to zero as rj goes to 
zero. Theorem [H however, does not ensure that there is a unique positive stationary distribution. 
For this stronger conclusion, there has to be sufficient noise in the system to ensure after enough 
time any positive population state can move close to any other positive population state. More 
precisely, given r^ > 0, we say that {Xt} is irreducible over S \ S^ if there exists a probability 
measure $ on S \ S,, such that for all a; G S \ S,, and every Borel set A C S \ S^ there exists n> 1 
(depending on x and A) such that 

P,.(X„ eA)>0 
whenever $(v4) > 0. 

Theorem 2 (Uniqueness). Assume that {Xt} is irreducible over S \ S^ for all r] > 0, and that the 
assumption of Theorem U\ holds. Then there exists a unique invariant probability measure it such 
that 7r(So) = and the occupation measures Ut converge almost surely to tc as t ^ 00, whenever 
Xo = X G S \ So . 

Theorem |2] ensures the asymptotic distribution of one realization of the population dynamics is 
given by the positive stationary distribution vr. Hence, vr provides information about the long-term 
frequencies that a population trajectory spends in any part of the population state space. To gain 
information about the distribution of Xf across many realizations of the population dynamics, we 
need a stronger irreducibility condition. This stronger condition requires that after a fixed amount 
of time independent of initial condition, any positive population state can move close to any other 
positive population state. More precisely, we say that {Xt} is strongly irreducible over S \ S,, if 
there exists a probability measure $ on S \ S^, an integer n > 1 and some number < h < 1 such 
that for all a; G S \ S^ and every Borel set A C S \ S^ 

P.(Xn eA)> h^A). 

To state the next result given /x, i/ G P define 

ll/i — z/|| = sup lyu(-B) — i^{B)\ 

B 

where the supremum is taken over all Borel sets -B C S \ Sq. 

Theorem 3 (Convergence in distribution). In addition to the assumptions of Theorem\^ assume 
that {Xt} is strongly irreducible over S \ S,, for all r] > 0. Then the distribution of Xt converges to 
71 as t ^ 00 whenever Xq = x G S \ So; that is 

lim ||P^.[Xi G ■] - 7r|| = for allxeS\ Sq. 
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Remark 1. Suppose that there exists a nonzero continuous function p: S\SoxS\Soi— !■ R+ an 
integer n > 1 and a probabihty v over S \ Sq such that for all x G S \ Sq and Borel set A C S \ Sq 

F.[X„gA] > f p{x,y)uidy). 

J A 

Then {Xt\ is strongly irreducible over S \ S,, for all r^ > 0. 

2.5. Robust persistence. Under an additional assumption, our main condition ensuring persis- 
tence is robust to small variations of the model. The importance of this robustness stems from 
the fact that all models are approximations to reality. Consequently, if nearby models (e.g. more 
realistic models) are not persistent despite the focal model being persistent, then one can draw few 
(if any!) conclusions about the persistence of the modeled biological system. To state our result 
about robustness, let g{x,^) = gi{x,^), . . . ,gk{x,^) be fitness functions. The model 

(4) Xt+,=g{Xt,^t+^)oXt 

is called a 6 -perturbation of (QP provided g satisfies conditions A3-A4 and 



supE[||/(x,e)-^(x,OII]=sup / \\f{x,0-9{x,0\\m{dO<S- 

Proposition 2. Assume the dynamics ^ satisfies hypothesis (i) of Theorem U\ and there exist 
constants < a < /3 < oo such that a < fi{x,C,) < /? for all i,x,^. Then there exists 6 > such 
that every 6— perturbation of (1\) satisfies hypothesis (i). 

3. Continuous time models 

For stochastic differential equation models, we assume, for presentational clarity, that S = A = 
{x G R^ : Yli ^i — !}■ However, our results hold more generally for a compact region that is forward 
invariant for the stochastic dynamics. The population dynamics on A consists of a "drift" term 
that describes the dynamics in the absence of noise and a "diffusion" term that describes the effects 
of environmental stochasticity on the population dynamics. The drift term for population i is given 
by X^FilXt) where Fi is its per-capita growth rate. To allow for correlations of environmental fluc- 
tuations across populations, we assume the environmental noise is generated by an m-dimensional 
standard Brownian motion {B}, . . . , B'^) and per-capita effect of B^ on the growth of population j 
is given by S^(Xi). Under these assumptions, we arrive stochastic differential equations of the form 

m 

(5) dXl = Xl[F,{Xt)dt + J2 n{Xt)dBlli = l,...,k. 

To ensure existence and uniqueness of solutions of ([5]), we assume that Fi and S^ are real valued 
Lipschitz continuous maps on A. To ensure that the population dynamics remain on A (i.e. A is 
invariant), we assume that for each x G A, the drift vector x o F{x) and the diffusion terms 

(6) S^{x) = X o S''(x), j = 1, . . . ,m, 

are elements of the tangent space TA = {u E iV' : J2j=i ""j = 0} of A. 
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The stochastic differential equation i^ defines a continuous time Markov process {Xt}t>o on A. 
We let {Pt}t>o denote the associated semigroup defined by 

Pth{x)=E[h{Xt)\Xo = x] 

for every bounded or nonnegative measurable function /i : A — t- R. Pth{x) is the expected value of h 

at time t given that initial population state is x. A probability /i on A is called invariant (respectively 

ergodic) provided it is invariant (respectively ergodic) for Pt for all t > 0. The occupation measure 

of {Xt}t>o is the measure 

1 /•* 
n* = - / 6xsds. 



t _ 
nt(y4) corresponds to the fraction of time spent in the set A C A by time t. 

The analog of the per-capita growth rate for these continuous time processes is given by 

(7) Xi{x) = Fi{x) - -aii{x) 

where 

a.,(x) = ^Sf(a:)S^^(a:). 
fc=i 
When Aj(x) > 0, the population tends to increase. When \i{x) < 0, the population tends to 
decrease. Like in the discrete-time case, define 



(8) Ai(/i) = / Xi{x)n{dx) 

and 

(9) A*(/i) = maxAj(yu). 

i 

In Appendix B, we prove the following continuous-time analog of Theorem [1] 

Theorem 4. Assume that one of the equivalent conditions (i) and (ii) of Theorem U\ hold where 
Aj(/i) and A*(/i) are given by formulaes ^, ^ and ^. Then the conclusion of Theorem IJ\ hold 
for the occupation measure of the process {Xt}t>o solution to ^. 

To ensure the existence of a unique stationary distribution and convergence toward this distri- 
bution, we need an appropriate irreducibility condition that ensures the noise can locally push the 
dynamics in all directions. More precisely, we call the system ([5]) nondegenerate if the column 
vectors S^{x), . . . , S"^{x) span TA for all x G A \ Aq. 

Theorem 5. Assume that ^ is non-degenerate and the assumption of Theorem [7] holds. Then 
there exists a unique invariant probability vr such that 7r(Ao) = 0. Furthermore, 

(i) The distribution of Xt converges to n as t —)■ oo whenever Xq = x G A \ Aq; that is 

limt-^oo\\^x[Xt G •] - 7r|| = for all x e A\ Aq, 

(ii) The occupation measures Ut = j J^ Sx^ds converge almost surely to n, whenever Xq = x G 

A\Ao. 
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3.1. Robust persistence. Let F and S be real valued Lipscliitz continuous maps on A with the 
property that for each x G A, the drift vector x o F{x) and the diffusion terms S^{x) = x o J]^[x), 
are elements of TA. The stochastic differential equation 



(10) 



dXl = Xl[F,{Xt)dt + Y, n{Xt)dBlli = l,...,k; 



is called a 6 -perturbation of (j5]) if 



sup||F(x) -F{x) 



+ ||E(a;)-E(a;)|| < 6. 



Proposition 3. Assume that the dynamics ^ satisfies hypothesis (z) of TheoremUi Then there 
exists 6 > such that every (5-perturbation of ^ satisfies hypothesis (z). 



In the case S(x) = 0, Proposition [3] combined with Theorem H] or O implies that every sufficiently 
small random perturbation of the deterministic system 

is persistent, provided that 



X o F{x) 



sup 



Fi{x)^{dx) > 



where the sup remum is taken over the invariant probabilities of fITT]) supported by Aq. This fact was 



also proved in iBenaira et al.l | 2008l. Theor em 3.1] using other techniques. Hence, Theorems IH E] and 
Proposition [3] extend iBenaim et al.l 20081 . Theorem 3. 1] beyond small pert urbation of deterministic 
dynamics. We remark, however, the result obtained in iBenaim et al.l |2008| provides an exponential 



rate of convergence toward vr. It would be nice to see whether of not such a rate can be obtained 
under the more general assumptions of Theorem |5l 



4. Applications 



4.1. Lottery models and the storage effect. The lottery model of IChesson and Warnen 1981 
represents species that require a territory or "home" (an area held to the exclusion of others) in order 
to reproduce. Moreover, the model assumes that space is always in short supply and, consequently, 
all patches are occupied. Let XI denote the fraction of space occupied by species i at time t. The 
fraction of adults of species i dying in a time step is rrii. The spaces emptied by dying individuals 
are immediately filled by progeny which are produced at a rate bi{Xt,^t+i)Xl by species i. Here ^t 
is a sequence of i.i.d. random variables that represents environmental stochasticity. If all progeny 
are equally likely to fill empty spaces, then the probability an empty space is filled by species i 
equals 

&,(x„6+i)x- 
E':=MxUt^i)xf 
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Under these assumptions, the dynamics of the competing species are given by 



(12) 



Xl^, = {l-m,)Xl + J2^,Xi 



Y.MXuit+i)Xl 



on the state space A. For many choices of hi and ^t, ( TT2l) satisfies the irreducibihty assumptions of 
Theorems |2] and [3l For instance, the irreducibihty assumptions are satisfied if hi{Xtj^t+i) = Q+i 
are log-normally distributed or gamma distrib uted. 

When there are two species, IChessonI jl982l | analyzed this model when bi{Xt,^t) do not depend 
on Xt. We show how our results recover Chesson's persistence criteria. The set of ergodic invariant 
measures on Aq are the Dirac measures, 5(o,i) and 5(i,o), supported on the points (0, 1) and (1,0), 
respectively. At these ergodic measures, the invasion rates are given by 



/i 



5(1 



5, 



(1,0) 
(0,1) 



Ai(/i) 



A2(/i) 



E 







log [1 — nil + nil 



E 



fei((o,i),g) 

b2((0,l),C) 



log 1 



™ I ^ MiMM) 



Theorem [T] ensures persistence if 

&i((o,i),0 



(13) 



E 



log I 1 — nil + f^i 



&2((0,l),O 



> and E 







log 1 - m2 + ni2 



&2((l,0),O 
&i((l,0),O 



>0 



Hence, we have recovered the "mutual invasibility" condition for persisten ce of Chesso n without 
making any monotonicity assumptions about the functions bi{x,^) (see also lEUnerl 1984| ). 



When the per-capita reproductive rates are frequency-independent i.e. 6i(Xj_^^_|_j_)_^^_^2+j_§s4 
£/ = _ (£/,£^), the persistence condition (IT^ can be used to illustrate what I Chesson and Warner 



198l| call the "storage-effect." In the absence of environmental stochasticity, IChessonI (l982| has 
shown that coexistence is not possible. If there is environmental stochasticity and all individuals 
die between generations i.e. rrii = 1 for all i, then flT3l) simplifies to 

E[loge'] > E[loge'] and Ejlog^^ ] > Ejlog ^^] 

Both of these conditions can not be meet in which case IChessonI |l982l . Thm. 3.5] has shown 
that one of the species goes extinct with probability one. Hence, when individuals are short lived, 
coexistence does not occur. On the other hand, if individuals are long-lived i.e. mj ~ for all i, 
then the approximation log(l + x) = x + 0{x'^) applied to (TT3|) yields the persistence criterion 



E 






> 1 and E 



i! 
e 



> 1. 



This condition is meet when the species exhibit some temporal partitioning: the reproductive rates 
^l and C,f are not overly correlated. Intuitively, long-lived individuals, unlike short-lived individuals, 
can "store" their numbers over periods of poor conditions and, thereby, take advantage of future 
good conditions. This ability to store for the future in conjunction with temporal partitioning 
mediates coexistence. 

For lottery models with three or more species, persistence criteria can be more subtle as they 
may require determining the invasion rates at non-trivial ergodic measures. However, an interesting 
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exception occurs with a rock-paper-scissor version of the lottery model i.e. species B displaces 
species A, C displaces B, and A displaces C. To model this intransitive interaction, we assume 
that the per-capita reproductive rates are linear functions of the species frequencies 



where 



bi{Xt,C,t+i 



6 



l) = 


-> 

3 


,^t+l^t 


A 


at 


lt\ 


It 


A 


at 


at 


It 


PtI 



where at> Pt> lt> ^ for all t. For simplicity, we assume that iri^ = m for all i. 

For any pair of strategies, say 1 and 2, the dominant strategy, 1 is this case, displaces the 
subordinate strategy. Indeed, assume Xq = 0. If yt = X^/X} and zt = J2iQ+i-^ty then 



Vt+i 



[1 - m)zt + m{-ft+iXl + f3t+iX^ 
1 - ni)zt + m{l3t+iXl -f at+iX^ 



■yt<yt 



is a decreasing sequence that converges to 0. Hence, the only ergodic measures on Aq are Dirac 
measures 6x supported on x = (1, 0, 0), (0, 1, 0), (0, 0, 1). At these ergodic measures, the invasion 
rates are given by 



/^ 


Ai(/i) 


A2(/^) A3(^) 


^(1,0,0) 
'^(0,1,0) 
^(0,0,1) 




E[log(l-m + m7i//3t); 
E[log(l -m + mat/Pt)\ 


E [log {1 -m + m at /(3t)] E \og{l - m + m -ft/ (3t) 
E [log (1 - m + m at //3t) 
E[\og{l -m + m^t/Pt)] 



A straightforward algebraic competition reveals that the conditions for persistence are satisfied if 
and only if 

(14) /(m) := E [log (1 - m + mat/(3t)] + E [log (1 - m + m-ft/(3t)] > 

We conjecture that if the opposite inequality holds, then persistence does not occur. 

To see the role of the storage effect for these rock-paper-scissor communities, we can examine 



how the sign of I{m) depends on m. Since /(O) 
non-empty interval of m values if and only if 



and /'' 



,m 



< for < 771 < 1, I(m) > for a 



(15) 
Moreover, if 

(16) 



/'(O) = E 



'at 


A. 


La 



2>0 



/(I) = E 



1 '^t 1 
log -T + log 

Pt 



A 



>o 



then the community persists for all < ?7i < 1. However, if (1151) holds but (fT6!) does not, then 
the community persists for < m < m* for some m* < 1. Hence, as in the two species example 
of Chesson and Warner, competitive communities with intransitives are more likely to coexist if 
individuals have longer generation times. However, unlike the example of Chesson and Warner, 
environmental noise can disrupt as well as enhance coexistence (see discussion in section [5]). 
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4.2. Discrete Lotka-Volterra dynamics with disturbances. Consider k interacting species 
whose dynamics in the absence of environmental disturbances is given by 

Xt+i = Xto exp{AXt + b) 

where the matrix A describes pairwise interactions between species and b describ es the intrinsic 



rates of growth of each species. These dynamics of this system were studied by iHofbauer et al. 



(l987j . To account for stochastic disturbances of these dynamics, we assume that the fraction of 



individuals of species i surviving environmental disturbances is Q € (0, 1] at time t. Then the 
dynamics become 

(17) X,+i = Xt o exp{AXt + b) o ^i+i 

An algebraic characterization of bound edness in terms of the matrices A and b remains an open 



problem even without the stochasticity iHofbauer et al.l |1987j defined the interaction matrix A 



to be hierarchically ordered if there exists a reordering of the indices such that An < for all i 
and Aij < whenever i < j. While this assumption excludes all types of mutualistic interactions, 
it allow s for any type of pred ator-prey or competitive interaction. The following lemma extends 
work of IHofbauer et al.l 1987l | by showing that hierarchically ordered systems remain bounded in 



the presence of environmental disturbances. For these systems, the irreducibility conditions of 
Theorems [2] and [3] are meet whenever ^t has a positive, continuous density on the interval (0, 1). 

Lemma 1. // (TT7j) is hierarchically ordered, then there exists K > such that Xt G [0,-ft']'^ for 
t>k + l. 



Proof. Following IHofbauer et al.l [1987l | observe that 

Xl,<XlexpiA^,Xl + b^) 

for all t as Ay < for all j > 2 and Q < 1- Hence, X^^^ is bounded above hj Ki = — exp{bi — l)/Aii, 
and X} e [0, Ki] for t > 2. 

Assume that there exist Ki such that XI G [0,-/^^] for i < j — 1 and t > i + 1. We will show 
that there exists Kj such that X} G [0, Kj] for t > j + 1. Indeed, by the hierarchically ordered 
assumption and our inductive assumption, 

Xi^, < XI exv{A,,Xi +h + Y. I^^-^I^^) 

for t > j. Hence, Xj < Kj for t > j + 1 where Kj = —exp{bj + X]i<i \^ji\^j ~ '^)/^jj- Defining 
K = max Kj completes the proof. D 

The following lemma shows that verifying persistence can reduce to a line ar algebra problem. In 



particular, this lemma implies that all the permanence criteria developed by IHofbauer et al.l |1987 
for hierarchal systems extends to these stochastically perturbed Lotka-Volterra systems. 

Lemma 2. Let fi be an ergodic measure for (1171) and / C {1, . . . , A;} be such that fi{{x G S : x* > 
iff i G 1} = 1 . Define /3i = bi + E[log^^*]. // there exists a unique solution x to 

^ AijXj + /3j = for i G I and Xi = for i ^ I 



PERSISTENCE IN FLUCTUATING ENVIRONMENTS 



13 



then 



Ai(^) 



/ j j ^ij-^j ~r Pi 



ifiel 

otherwise. 



Proof. Let /i and I be as assumed in the statement of the lemma. Assertion {iii) of Proposition [T] 
imphes that 



= Aj(/i) = 2, ^ij / ^j f-idx) + l3i 



for all i & I. Since we have assumed there is a unique solution to this system of linear equations, it 
follows that J Xifi{dx) = x, for all i and the lemma follows. D 

4.3. Stochastic replicator dynamics. A particular case of the continuous time equat ions (E]) is 
given by the stochastic replicator dynamics introduced by iFudenberg and HarrisI 1992| . Assume 
that the fitness of population i is described by a function /j : A i— )■ R of the state variable x and 
that the per capita growth rate of the number of individuals in population i is stochastic, given by 
sum of the fitness of strategy i and a standard Brownian motion Bi{t): 

(18) dY; = Y;{f,{Xt) + adBl), 

where XI = Y^/ ^ . F/ and cr^ > 0. Then the law of motion for the state Xt can be obtained via a 
straightforward application of Ito's formula and takes the form (^ with 

Fi{x) = fi{x) - ajxi -^Xj{fj{x) - a]xj) 



and 

m^) = {Sij-Xj)aj. 
If there are only two types (i.e. k = 2), then the only ergodic measures on Aq are the Dirac 
measures at a; = (1, 0) and x = (0, 1), respectively. At these Dirac measures, the invasion rates are 
given by 



fx 



^(1,0) 



5, 



(0,1) 



Ai(^) 



A2(^) 







A(0,l)-/2(0,l)-i(a2-a^ 



/2(l,0)-/i(l,0) 





WT 



o. 



Hence, both strategies persist if 



and 



/i(0,l)-^>/2(0,l)-| 



o-T 



/2(l,0)-^>/i(l,0)-^ 

When these inequalities are satisfied, one c an solve explic itly for the density of the positive stationary 
distribution of X^ = x on [0, 1] (see, e.g., iKimura] |l964l |) 



p{x) 



C 



exp 



Fi(x, l-x,0) 
V{x) 



dx 
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where V{x) = x^(l — x)^{af + (t|) and C is a normalization constant. For example, if fi are linear 
functions, then this stationary distribution is given by a beta distribution as we illustrate in the 
next example. 

Since we can solve for non-trivial ergodic measures for two interacting types, we can derive explicit 
conditions for persistence of three interacting types. As an illustration, consider three interacting 
types with per-capita growth rates fi{x) = ri + 6x3, f2{x) = r2, and fsi^x) = r^ — cxi. Here, 
interactions between types 1 and 3 provide a benefit 6 > to type 1 and a cost c > to type 3. To 
allow for coexistence, we assume the following tradeoff r^ — o"|/2 > r2 — o"|/2 > ri — a^/2. 

Our analysis begins with pair-wise interactions. When type 1 is not present i.e. Y^ = 0, the re- 
maining types i = 2,3 exhibit geometric Brownian motions of the form Y^ = Yq exp ((r^ — (jf/2)t + (JiBl) 
where Bl are independent Brownian motions. Since r^ — a\l2 > r2 — cr|/2, Xt converges almost 
surely to (0, 0, 1) whenever Y^ = and Yq > 0. Similarly, when type 3 isn't present i.e. Yq = 0, 
the remaining types i = 1,2 exhibit geometric Brownian motions and Xt converges almost surely to 
(0, 1, 0) whenever Yq > 0. To determine the outcome of the pairwise interaction between genotypes 
1 and 3, we need the invasion rates 

Ai(0, 0, 1) = ri + 6 - al/2 - r^ + al/2 and hil, 0, 0) = rg - c - al/2 - n + al/2 

Both of these invasion rates are positive provided that 

(19) b>r3- al/2 - n + al/2 > c 

When flTOl) holds, there is a unique invariant measure /i on {a; G A : xix^ > 0,a;2 = 0} whose 
density p{xi) := p{xi, 1 — Xi) is given by 

, ^ _ C / f ri + b{l - Xi) - rg + cxi + q-|(l - Xi) - a\xi ^ 



xf(l-X?)K + ai) ^\J a;2(i_^2)(^2 + ^2) 

which upon integration yields 



(20) p{x,) = 

where B{a,f3) is a normalization constant and 



X/ -| UjO 

B{a,/3) 



^ 2(ff|-r3 + ri + b) _ 2{al + rs - ri - c) 

at + ai at + ai 



Fudenberg and Harris! [19921 . Proposition 1] provide a detailed derivation of this stationary distri- 



bution for linear /i and /s. 

To understand the fate of the three interacting genotypes, there are (generically) three cases to 
consider. First, assume that (I19p is satisfied. The invasion rate for type 2 at the invariant measure 
/x, see (120]) . is given by 

._.. ,,. bal - (b - c)a^ - caf - 2brs + 2{b - c)r2 + 2cri + 2bc 

^^^> ^'^^^ 2ib^) 

Whenever A2(/i) > 0, Theorem 4 ensures there is a unique positive stationary distribution on A by 
choosing ps ^ P2 ^ Pi > 0. Since (fT9l) implies 6 — c > 0, (!2T]) implies that stochastic fluctuations 
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in genotype 3's per-capita growth rate can mediate coexistence, while stochastic fluctuations in the 
per-capita growth rates of the other two genotypes can disrupt coexistence. 

Next, assume that (TT9l) doesn't hold. If 6 < r^ — a1/2 — r2 + (T\/2, then the invasion rates Ai(0, 0, 1) 
and A2(0,0, 1) are both negative and we conjecture coexistence doesn't occur. Alternatively if 
h^c > r^ — (y\l1 — r2 + o"2/2, then the boundary dynamics exhibit a rock-paper-scissor dynamic 
and the only ergodic invariant measures are the Dirac measures at the vertices. At these ergodic 
measures, the invasion rates are given by 

/i Ai(;u) A2(/i) \z{[i) 



^(1,0,0) 
^(0,1,0) 
^(0,0,1) 



rs - ^272 - ri + aljl r^-c- al/2 - rs + ^2^/2 

ri - al/2 - r2 + al/2 rg - al/2 -r^^ al/2 

ri + 6 - a2/2 - rs + ai/2 r2 - ctI/2 - r^ + al/2 

A standard computation yields that the persistence criterion is satisfied when product of the positive 
invasion rates is greater than the product of the absolute value of the negative invasion rates. This 
occurs when b > c. Hence, for this rock-paper-scissor dynamic, environmental stochasticity has no 
effect on coexistence. 



5. Discussion 

Understanding under what conditions interacting populations, whether they be plants, animals, or 
viral particles, coexist is a question of theoretical and practical importance in population biology. 
Both biotic interactions and environmental fluctuations are key factors that facilitate or disrupt 
coexistence. To better understand this interplay between these deterministic and stochastic forces, 
we develop a mathematical theory extending the nonlinear theory of permanence for deterministic 
systems to randomly forced nonlinear systems. This theory pr ovides a b iologically i nterpretable 
criterion for coexistence in the sense of stochastic boundedness [Chessonl . Il978l . Il982l |. Using this 



theory, we illustrate that environmental noise enhances or inhibits coexistence in communities with 
rock-paper-scissor dynamics, has no effect on coexistence in certain Lotka-Volterra communities, 
and can promote or inhibit genetic diversity. 

Our condition for coexistence requires that there is a fixed set of weights associated with the 
interacting populations and this weighted combination of populations' invasion rates is positive for 
any (ergodic) stationary distribution associated with a subcoUection of populati ons. This crite- 



rion is th e stochastic analog of a per r aanen ce criterion for deterministic systems [Hofbauerl . 11981 



Schreiberl . l200Cll . iGaray and Hofbauerl . |2003| | . Since these invasion rates, defined as the average per- 



capita growth rates on the stationary distribution, equal zero for populations supported by the 
stationary distribution, this criterion requires that a missing population has a positive invasion 
rate. Hence, for pair-wise interactions, this criterion reduces to the "mutual invasibility" criterion. 
When this condition holds and there is sufficient noise in the system (i.e. irreducible), we have 
shown the populations approach a unique positive stationary distribution whenever all types are 
initially present. Hence, the probability that the abundance of any population falls below a critical 
threshold is arbitrarily small for sufficiently small thresholds. Moreover, the fraction of time any 
population spends below this threshold is arbitrarily small for sufficiently small thresholds. 
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The need for this generahzation of the mutual invasibhty criterion is illustrated i n the determinis- 

tic lit erature by models of communities exhibiting rock-paper-scissor type dynamics [Hofbauer and Sigmundl . 

J98| . Here, we extended this analysis to stochastic counterparts of these models. If we assume 
that dominant strategies (e.g. rock) in these models gain a benefit bt when playing subordinate 
strategies (e.g. scissor) and subordinate strategies pay a cost q when playing dominant strategies, 
then our coexistence condition ( ITSjl for long-lived individuals becomes 



(22) 



E 






>E 



2i 

A 



where Pt is the "base" payoff. The effect of stochasticity in bf, Ct, and Pt on whether this criterion 
holds depends on the correlations between the various payoffs. Negative correlations between base 
payoffs and benefits (i.e. getting large benefits when base payoffs are small) makes f l22|) more likely 
to hold, while negative correlations between base payoffs and costs make it less likely to hold. 
Hence, stochasticity can facilitate coexistence when there are negative correlations between benefits 
and base-payoffs, but inhibit coexistence when there are positive correlations between benefits and 
base-payoffs. 

For three competing genotypes in which the genotypes with the highest per-capita growth rate 
is exploited by the genotype with the lowest per-capita growth rate, we have shown that the effect 
of environmental fluctuations on coexistence is subtle. When the three genotypes exhibit a rock- 
paper-scissor dynamic, stochastic fluctuations have no effect on the coexistence criterion; coexistence 
requires that the benefit to the exploiter exceed the cost paid by the exploited. When there is no 
rock-paper-scissor dynamic, fluctuations in the per-capita growth rate of the exploited genotype 
can enhance diversity, while fluctuations in the other two genotypes can disrupt coexistence. Since 
this noise-induced coexistence occurs in populations with overlapping genera t ions ( i.e. a stochastic 
differential equation model), these results partially support lEUner and Sasakil [l996|'s assertion that 
"fluctuating selection can readily maintain genetic variance in species where generations overlap in 
such a way that only a fraction of the population is exposed to selection." 

We also have shown that stochastic variation in mortality or disturbance rates have no ef f ect th e 



coexistence criteria for discrete-time Lotka Volterra models developed by iHofbauer et al.l |1987 



This surprising outcome stems from the fact that the per-capita growth rates in these models are 
linear functions in the population abundances. Adding non-linearities (e.g. predator saturation) to 
the per-capita growth rates will alter this conclusion, but the nature of this alteration remains to 
be understood. 

Numerous mathematical challenges remain at this interface of random forcing and biotic in- 
teractions. For example, do the same criteria hold when there are temporal correlations in the 
environmental variables? We suspect the answer is yes. Alternatively, we conjecture that invert- 
ing the coexistence criterion (i.e. a convex combination of invasion is negative for all stationary 
distributions supporting subsets of species) implies an asymptotic approach to extinction with prob- 
ability one. Wh ile this conjecture ha s been proven for stochastic differential equations with small 



diffusion terms |Bena"im et al.l . |2008| . it needs to be shown for stochastic difference equations or 
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stochastic differential equations with large diffusion terms. Finally, only recently have invasion- 
based p ermanence criteria been developed for deterministic models of structured interacting popu- 



lations [Hofbauer and Schreiberl . Iln press! ]. These structured models can account for heterogeneity 
amongst individuals in terms of the location, size, and age. Developing a mathematical frame- 
work to deal with these heterogeneities is an exciting challenge that would help us understand how 
interactions between individual heterogeneity, temporal heterogeneity, and and biotic interactions 
determine diversity. 
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Appendix A. Proofs for discrete time models 
A.l. Proof of Proposition [1]. 

Lemma 3. Let g : S x E \-^ H be a measurable map such that sup^g,^ f g{x,^)'^m{dC,) < oo. Define 
g{x) = J g{x,^)m{d^). Then 

(i) For all X & S and Xq = x 

t—>oo t 

with probability one. 
(ii) Let fi be an invariant (respectively ergodic) probability measure for {Xt), then there exists a 
bounded measurable map g such that with probability one and for fi-almost every x 

r ^S = 9iXs,^S+l) y J2s = 9iXs) ./ N , ^ 

lim — ^-^ = hm = g[xj when Xq = x. 

t—^oo t t— >-oo t 

Furthermore 

g{x)fi{dx) = / g{x)fi{dx) (respectively g{x) = / g{x)fi{dx) /x — almost surely). 



Proof. The first assertion follows from the strong law of large number for martingales, since g{Xs, ^s+i)- 
Pg{Xs) is a square integrable martingale difference. The sec ond assertion follow s frorn Birkhoff's 



ergodic theorem applied to stationary Markov Chains (see iMeyn and Tweedid |1993| . Theorem 



17.1.2) D 
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The first two assertions of Proposition [T] follow directly from the preceding lemma applied to 
g{x,C,) = \ogfi{x,C,)- For the third assertion, notice that, by assertion (i) of Proposition [T] 

hm — - — = Xi{x} 

t— s>oo I 

for /i-almost all x G S \ Sq. Let S*''' = {x G S : Xi > r]} and 77* > be such that /i(S''^) > for all 
7] < 7]*. By Poincare Recurrence Theorem, for /i almost all x G S**'' 

F^Xt G S*''' infinitly often ] = 1 

for 7] < rj*. Thus Aj(x) = for /i-almost all x G S*''' with t] < rj*. Hence A*(x) = for yU-almost all 
X G UneN S*'"*^/" = {x G S : Xi > 0}. This proves assertion (Hi). 

A. 2. Proof of Theorem [1], The proof of the first assertion of the theorem follows from the fol- 
lowing lemma. 

Lemma 4. The following two conditions are equivalent: 

(i) For all invariant probability measures fi supported on Sq, 

A*(yu) := maxAj(/i) > 

i 

(ii) There exists p E A such that 

J^PiAi(/i) > 

i 

for all ergodic probability measures yU supported by Sq. 

Proof. To see the equivale nce of the conditions we need the following version of the minimax theorem 
(see, e.g.. ISimmonj 19981 ): 

Theorem 6 (Minimax theorem). Let A, B be HausdorfJ topological vector spaces and letT : AxB ^ 
Ti be a continuous bilinear function. Finally, let E and F be nonempty, convex, compact subsets of 
A and B, respectively. Then 



We have that 



minmaxr(a,6) = maxminr(a,6) 

a&E b&F b&F a&E 



min max A j (/i) = min max > pi\i(n) 



where the minimum is taken over invariant probability measures /i with support in Sq. Define A to 
be the dual space to the space bounded continuous functions from So to R and define _B = R'^. Let 
D G Ahe the set of invariant probability measures and E = A. With these choices, the Minimax 
theorem implies that 

(23) min max A j (/i) = max min > piXi(n) 

i 

where the minimum is taken over invarian t probability measures /i with support in Sq. By the 
ergodic decomposition theorem iMana 1983|, the minimum of the right hand side of (123|) is attained 
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at an ergodic probability measure with support in Sq. Thus, the equivalence of the conditions is 
established. D 

The proof of the second assertion of the theorem follows from the next two lemmas. 

Lemma 5. For all e > 0, there exists a t] > such that /i(S^) < e for every invariant probability 
measure ^ with yu(S \ Sq) = 1- 

Proof. Suppose to the contrary, there exists e > and invariant measures fin such that yU„(S\So) = 1 
and yu(Si/„) > e for all n > 1. By Proposition [H A^,(/i„) = for all n. Let /x be a weak* limit 
point of these measures. Then /i(So) > e and A*(yu) = 0. Since S = Sq U S \ Sq and Sq, S \ Sq 
are invariant, there exists a > such that /i = az/g + {1 — 0)1/1 where z/j are invariant measures 
satisfying t'o(So) = 1 and z/i(S \ So) = 1. By Proposition [H A*(i/i) = 0. By assumption, A*(z/o) > 0. 
Hence, = A*(/i) > a\^{uo) > 0, a contradiction. 

D 

Lemma 6. For all x G S\So, with probability one the set of weak* limit points ofUt is a nonempty 
compact set consisting of invariant probabilities fi such that //(S \ Sq) = 1. 

Proof. The process {Xt}^Q being a Feller Markov chain over a compact set S, the set of weak* 
limit points of {Iltl^Q is almost surely a non-empty compact subset of V consisting of invariant 
probabilities. To see why this latter point is true, let /i : S — ?■ R be continuous function and define 

g{x, = h{x o /(x, 0) and g{x) = / g{x, m{d^). 
Since Xt+i = Xto f{Xt,^t+i), h{Xt+i) = g{Xt,it+i) and 
\im f h{x)Ut{dx)- f Ph{x)Ut{dx) =lim,_„o M ^ /i(X,) - /" /i(/(X„0 o X,) m(rfO 

hm i ( V g{X,, Ui) - 9{Xs) ] + ^ (^(X,) - g{X, 

= almost surely. 

where the last line follows from assertion (i) of Lemma [3l Hence, J^h^x) fi{dx) = J^Ph{x) fi{dx) 
with probability one for weak* limit points /x of H^. Since S is compact, the set of continuous func- 
tions from S to R is separable metric space and with probability one J^ h{x) fi{dx) = J^ Ph{x) fi{dx) 
for all weak* limit points of H^ and all continuous functions /i : S — )■ R. Thus, the weak* limit 
points of Uf are almost-surely invariant probability measures. 

Assertion (i) of Lemma E] applied to g{x,^) = log(/j(x,^)) gives we have 



s 



)) 



^.^ logX--logx.-El;;A.(X,) ^ ^ 



Since limsupi_^oo j (log-^i — logXj) < almost surely, we get that 
(24) A,(/i) < 
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almost surely for any weak* limit point fi of {Hij^Q. 

Since S = S \ So U Sq, S \ Sq is invariant, and Sq is invariant, there exists a G (0, 1] such that 
/i = (1 — a)z/o + aui where uq is an invariant probability measure with z/o(So) = 1 and ui is an 
invariant probability measure with z/i(S \ Sq) = 1- By Proposition [H Aj(z/i) = for all i. Thus, 
(1 — a)Aj(z/o) < for all i. Since by assumption Aj(z/o) > for some i, a must be 1. 

n 

A.3. Proof of Theorems O and O 

Lemma 7. There exists t] > and e > such that 

(i) A*(/i) > e for every invariant probability fi with /i(S^) = 1, and 



(ii) Pa;[-^t ^ S^ for some t] = 1 for a// x G S \ S, 



0- 



Proof. To prove (i), assume to the contrary that there exists a sequence {^n}'^=i of invariant prob- 
abilities such that K{f^n) < ^/n and yU„(Si/„) = 1. Let /x be a weak* limit point of the {nn}'^=i- 
Hence X*{fi) = by continuity of A*, and yu(So) = 1 since /in(Sa) = 1 for all a > and n large 
enough. However, this contradicts the assumption that A*(/i) > 0. Hence, there exists e > and 
rj > such that (z) holds. 

To prove (u), let £ be the event £ = {Wt > : X^ G S,,}. On £, Ut is almost surely supported by 
S^. Hence, by (i), A*(/i) > e almost surely on £ for any weak* limit point fi of Hj. This contradicts 
in the proof of Lemma O Hence, £ has probability zero, D 



We now pass to the proof of Theorem [2l Let r/ > be like in Lemma [7] (ii) and $ the probability 
on S \ S,, given by the irreducibility assumption. Then, for all a; G S \ So and every Borel set 
A <Z Sri IPx[3n > 1 Xn G A] > whe never ^(A) > 0. In other words, {Xt} is a ^—irreducible 



Markov cha in on S \ Sn in the sense o f iMeyn and Tweedid |l993l . Chapter 4, Section 4.2]. It then 
follows (see iMeyn and Tweedid |l993l . Proposition 10.1.1, Theorem 10.4.4]) that {Xt} admits at 



most one invariant probability measure on S \ Sq and Theorem [2] follows from Lemma O 

If one now assume that {Xt} is strongly irreducible over S\S^ then {Xt} becomes Harris recurrent 
and aperiodic on S \ Sq. Since, by Theo r em [2] it is a positive Harris chain. Theorem [3] follows from 
Orey's theorem (see iMeyn and Tweedid |l993l . Theorem 18.1.2]) 



A. 4. Proof of Proposition [2]. Assume to the contrary that there exists a sequence of fitness maps 
{fl'n = idn, ■ ■ ■ , gn)}'n=i Satisfying assumptions A3-A4 such that 

(25) limsupE[]|(7„(x,O-/(a;,OII] = 

and 

max / \og{gl^{x,^))m{d^)fin{dx) < 



where /i„ is an invariant measure, supported by Sq, for the operator P„ associated to the Markov 
chain 

Xt+i = gniXt,^t+i) °Xt. 
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By compactness of S we may assume that //„—;• /x in the weak* topology. Since a < fi < /3 ioi all 
i and (12^ holds, it follows that 

lim / \og{gl^{x,^))m{d^)fin{dx) = / \og{ fi{x,^))m{d^)fi{dx). 

Hence, Aj(yu) < for all i. It remains to prove that /i is invariant for P to reach a contradiction. 
Let /i : S I— 7- R be a continuous map. Let e > 0. By uniform continuity there exists 6 > such that 
for all x,u,v E S, 

\\u — v\\ < 6 ^ \h{x o u) — h{x o v)\ < e. 
Thus 

\Pnh{x) - Ph{x)\ = \E[h{xog^,{x,0)-Hx°f{x,0)]\ 

< 2\\h\\¥[\\g^ix,0-fix,0\\>S]+e 

It then follows from f l25|) that lim„_>oo Pnh{x) = Ph{x) uniformly in x. Therefore 

lim / Pnh(x) jj,n{dx) = / Ph(x)fi{dx). 

n^ooj J 

Since by invariance of /i„ for _P„ 

lim / Pnh{x)nnidx) = lim / h(x)iJ,n{dx) = lim / h(x)jj{dx) 

n— >oo / n— >oo / n— >oo / 

we get 

proving that fi is invariant for P. 

Appendix B. Proofs for the continuous time models 

B.l. Proof of Theorem |4l. Let C be the infinitesimal generator of {Xt}t>o- It acts on C^ functions 
according to the formula 

(26) C^ix) = V ^{x)xiFi{x) + A^ix) 

^-^ OXi 

i 

where 

(27) Atjj{x) = -"^XiXjUij 



x)- ix) 






By Ito's formulae 

i){X^) - i,{x) - [ C^{Xs)ds = Mt 
Jo 
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is a martingale given by Mq = and 

4 = 1 * j = l 

where 5'-' is the vector given by (EJ. Applying this to ip{x) = log(xj) gives 

log(X,0 - log(xO - / X^{Xs)ds = Mt 
Jo 

with 

m 

i=i 
Hence 

m 

so that 

{M)t < Ct. 
Thus, by the strong law of large numbers for martingales, 

j.^ \ogiXl)-\ogix^)-J^KiX,)ds ^ ^ 

t->-oo t 

almost surely. The end of the proof is like the proof of Theorem [TJ Details are left to the reader. 



B.2. Proof or Theorem [5l By the nondegeneracy assumption, there exists (see e.g lDurrettl |1996l |. 
Theorem 3.8, Chapter 7) a continuous positive kernel pt{x,y) such that 

Pti^{x) = pt{x,y)'ilj{y)dy. 

Therefore, Theorem [T] applies to Pt for any t > 0. 

Let TTf denote the unique positive invariant probability measure of P^ for t > 0. We claim that 
TTf is independent of t. Indeed, ttj is invariant for P^t = P^ for all t > and A; G N. It follows that 
'n'k/2" is independent of k and n, and so, by the density of the dyadic rational numbers in the reals, 
TTt = IT for all t > 0. 

Now, for any continuous bounded function ip and any < s < 1, 

\Pn+sH^) - vr^l = \Pn{Psi^){x) " 7r(P,^)| < \\Pn{x, .) - 7r|| | |P,^| U 
where nil) stands for J ipdn. Hence, 

lim \\Pn+s{x,.) -7r|| = 



n— >oo 



SO assertion (i) of the theorem holds. The second assertion follows from the uniqueness of vr and 
Theorem |H 
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B.3. Proof of Proposition [3l Suppose ( TTOj) is a (5-perturbation of ([5]) with Xq = Xq = x. Then 
for all t > 

Xt-Xt = [ (Xs o F{Xs) - Xs o F(X,))rfs + f (Xso F{Xs) - X, o F{Xs))ds + 
Jo Jo 

[ (Xs o S(X,) - X, o S(X,))d5, + / (X, o S(X,) - X, o I](X,))d5, 
JO io 

Let 

v{t) = E^\\Xt-Xtf . 

Then, by the Cauchy-Schwartz inequality, the fact that ||Xs|| < 1, and the Ito isometry 

vit) < 4E \\fx,oFiXs)-X,oF{Xs)dsf + \\[XsoF{Xs)-XsoF{Xs)dsf 
. Jo Jo 

+ 11 / X, o S(X,) - X, o E{X,)dB,f + 11 / X, o S(X,) - X, o t{X,)dB,\\^ 
Jo Jo 

< At f E[||X,oF(X,)-X,oF(X,))||2]rfs + 4t / E[||F(X,) - F(X,)||2]d5 
JO Jo 

+4 / E[||X,oE(X,)-X,oS(X,)f]ds + 4 I E[||S(X,)-S(X,)f]ds 
Jo Jo 

Using the assumption and the Lipschitz continuity of X o -F(X) and X o S(X) it follows that, for 

some constant L, 

2x2 I AT I „,/„N J„ I /ij. t-2 



v(t)<AtL v{s)ds + Ar5' + AL v{s)ds + AtS 
Jo Jo 

Thus, for alH < T 

v{t) <Af v{s)ds + BS^ 
Jo 
where A = 4L{T + 1) and B = 4:T{T + 1). Hence, by Gronwall's lemma 

v{t) < e'^B5^ 

for all t <T. The remainder of proof is similar to the proof of [2l The details are left to the reader. 
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